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Abstract 

We study the optimal mechanisms in (e, S) -differential privacy for single integer- valued query function under a 
utility-maximization/cost-minimization framework. We show that the (e, S) -differential privacy is a framework not 
much more general than the (e, 0) -differential privacy and (0, 5) -differential privacy in the context of I 1 and £ 2 cost 
functions, i.e., minimum expected noise magnitude and noise power. In the same context of E 1 and £ 2 cost functions, 
we show the near-optimality of uniform noise mechanism and discrete Laplacian mechanism in the high privacy 
regime (as (e, 5) — > (0, 0)). 

I. Introduction 

Differential privacy is a framework to quantify to what extent individual privacy in a statistical database is 
preserved while releasing useful statistical information about the database (TJ. The basic idea of differential privacy 
is that the presence of any individual data in the database should not affect the final released statistical information 
significantly, and thus it can give strong privacy guarantees against an adversary with arbitrary auxiliary information. 
For more background and motivation of differential privacy, we refer the readers to the survey [0. 

The standard approach to preserve differential privacy for real-valued query function is to perturb the query output 
by adding random noise with Laplacian distribution. Recently, [3] shows that under a general utility-maximization 
framework, for single real-valued query function, the optimal e-differentially private mechanism is the staircase 
mechanism, which adds noise with staircase distribution to the query output. 

In this work, we study the (nearly) optimal mechanisms in (e, <5)-differential privacy for single integer-valued query 
function under a utility-maximization/cost-minimization framework, (e, (^-differential privacy is a relaxed notion 
of privacy, compared to the standard e-differential privacy introduced in (TJ. (e, <5)-differential privacy includes as 
special cases: 

• (e, 0) -differential privacy; in this standard setting, the optimal mechanism for a general cost minimization 
framework is the staircase mechanism as shown in |3j. In the high privacy regime, the standard discrete 
Laplacian mechanism too performs well. 

• (0, ^-differential privacy; this setting requires that the total variation of the conditional probability distributions 
of the query output for neighboring datasets should be bounded by S. In this paper we show that the uniform 
noise distribution is near-optimal in the (0, ^-differential privacy setting for a general class of cost functions. 

While the (e, <5)-differential privacy setting is more general than the two special cases - (e, 0) and (0, <5)-differential 
privacy - our main result in this work is to show that it is only more general by very little; this is done in the context 
of I 1 and £ 2 cost functions. We show the near-optimality of uniform noise and discrete Laplacian mechanisms in 
the high privacy regime (as (e, S) — > (0, 0)) for i 1 and £ 2 cost functions. 

The near-optimality of the two mechanisms (designed for the special cases of (e, 0) and (0, 6) differential privacy 
settings) is proved by demonstrating a uniform bound on the ratio between the costs of these two mechanisms and 
that of the optimal cost in the (e, S) differential privacy setting in the high privacy regime, i.e., as (e, S) — > (0, 0) 
for I 1 and £ 2 cost functions. 



A. Related Work 

Dwork et. al. JJJ introduce e-differential privacy and show that the Laplacian mechanism, which perturbs the 
query output by adding random noise with Laplace distribution proportional to the global sensitivity of the query 
function, can preserve e-differential privacy. Nissim, Raskhodnikova and Smith ||4) show that for certain nonlinear 
query functions, one can improve the accuracy by adding data-dependent noise calibrated to the smooth sensitivity 
of the query function, which is based on the local sensitivity of the query function. McSherry and Talwar |]5] 
introduce the exponential mechanism to preserve e-differential privacy for general query functions in an abstract 
setting, where the query function may not be real-valued. Dwork et. al. [6| introduce (e, <5)-differential privacy and 
show that adding random noise with Gaussian distribution can preserve (e, <5)-differential privacy for real-valued 
query function. 

Ghosh, Roughgarden, and Sundararajan [7] show that for a single count query with sensitivity A = 1, for a 
general class of utility functions, to minimize the expected cost under a Bayesian framework the optimal mecha- 
nism to preserve e-differential privacy is the geometric mechanism, which adds noise with geometric distribution. 
Brenner and Nissim [8 | show that for general query functions no universally optimal mechanisms exist. Gupte and 
Sundararajan [9] derive the optimal noise probability distributions for a single count query with sensitivity A = 1 
for minimax (risk-averse) users. @ shows that although there is no universally optimal solution to the minimax 
optimization problem in [9| for a general class of cost functions, each solution (corresponding to different cost 
functions) can be derived from the same geometric mechanism by randomly remapping. 

Hardt and Talwar ifTOl study the tradeoff between privacy and error for answering a set of linear queries over a 
histogram in a differentially private way. The error is defined as the worst expectation of the ^ 2 -norm of the noise. 
IflOl derives a lower bound for the error in low privacy regime by using tools from convex geometry and Markov's 
inequality, and gives an upper bound by analyzing a differentially private mechanism, X-norm mechanism, which 
is an instantiation of the exponential mechanism and involves randomly sampling from a high dimensional convex 
body. Recently, Nikolov, Talwar and Zhang [ 1 1 1 extend the result on the tradeoff between privacy and error to the 
case of (e, 5) -differential privacy. 



B. Organization 

This paper is organized as follows. We formulate the utility-maximization/cost-minimization under the (e, S)- 
differential privacy constraint as a linear programming problem in Section [II] In Section [Till, we study (0, 8)- 
differential privacy, and show the nearly optimality of the simple uniform noise mechanism. In Section IIVI we 
study the optimal mechanisms in (e, 6) -differential privacy, and show the optimality of uniform noise mechanism 
and Laplacian mechanism in the regime (e, 6) — > (0, 0). 



II. Problem Formulation 
Consider an integer-valued query function 

q:V^Z, (1) 

where T> is the domain of the databases. 

The sensitivity of the query function q is defined as 

A^ max \q{D x ) - q(D 2 )\, (2) 

D 1 ,D 2 CV:\D 1 -D 2 \<1 

where the maximum is taken over all possible pairs of neighboring database entries D\ and D2 which differ in 
at most one element, i.e., one is a proper subset of the other and the larger database contains just one additional 
element |2|. Clearly, A is an integer in this discrete setting. 

Definition 1 ((e, <5)-differential privacy [6|). A randomized mechanism K gives e-differential privacy if for all data 
sets Di and D2 differing on at most one element, and all S C Range(fC), 

Pr[K(D{) ES}< exp(e) Pr[fC(D 2 ) £S} + 5. (3) 
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The standard approach to preserving the differential privacy is to add noise to the output of query function. Let 
q{D) be the value of the query function evaluated at D C T>, the noise-adding mechanism K, will output 

K{D) = q(D) + X, (4) 

where X is the noise added by the mechanism to the output of query function. To make the output of the mechanism 
be valid, i.e., q(D) + X G Z, X can only take integer values. 

Let V be the probability mass function of the noise X, and use V% to denote Pr[X = i]. For a set S C Z, denote 
Pt[X g S] by Vs. 

In the following we derive the differential privacy constraint on the probability distribution of X from (01. 

Pr[/C(£>i) G S] < exp(e) Pr[/C(Z> 2 ) G S] + 6 (5) 

O Pr[g(£>i) + X G S] < exp(e) Pr[q(L> 2 ) + X G S 1 ] + +5 (6) 

&Vs- q ( Dl ) < exp(e) V S - q (D 2 ) + 8 (7) 

Ps' < exp(e) V sl+q{Dl )- q (D 2 ) + (8) 

where S' = S - q(Di) = {s - q{Dx)\a G S). 

Since (f3]l holds for any set S C Z, and — q(D2)\ < A, from ((HJ we have 

P s < exp(e) V s +d + 8, (9) 

for any set S C Z and for all |d| < A. 

Consider a cost function £(•) : Z — > K, which is a function of the added noise X. Our goal is to minimize the 
expectation of the cost subject to the (e, <5)-differential privacy constraint (|9): 

V* := min ^ C(i)V(i) (10) 

i— — oo 

subject to T s < exp(e) P s +d + 8, VS C Z, rf G Z, |d| < |A|. 

In this work, we restrict our attention to the scenario when the cost function C(k) is symmetric (around k = 0) 
and monotonically increasing for fe > 0. Furthermore, without loss of generality, we assume C(0) = 0. Using the 
same argument in Lemma 28 in 0, we only need to consider symmetric noise probability distributions. 

III. (0, 5) -Differential Privacy 

We first consider the simple case when e = 0, i.e., (0, <5)-differential privacy. The (0, 5) -differential privacy 
constraint requires that the total variation of the conditional probability distributions of the query output for 
neighboring datasets should be bounded by S. 

In the differential privacy constraint (|9), by choosing the subset S = Sk :={£:£ > k} for k G N and d = A, 
we see that the noise probability distribution V must satisfy the constraints 

A-l 

J2 V k+e<S, VfcGN. (11) 

i=o 

A. A = 1 

In the special case A = 1, the constraints in ( fTTT i are particularly simple: 

Pk <8; Vfc > 0. (12) 

For symmetric cost functions C(k) that are monotonically increasing in k > 0, we can now readily argue that the 
uniform probability distribution is optimal. 

To avoid integer rounding issues, assume ^ is an integer. 
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Theorem 1. If A = 1, then 

V*= ]T 5£ ( fc )> C 13 ) 



anc/ f/;e optimal noise probability distribution is 



V k = { n 24 " 25 (14) 
I otherwise 

B. General Lower Bound for A > 2 

We now turn to understanding (near) optimal (0, 8) privacy mechanisms in terms of minimizing the expected 
loss when the sensitivity A > 2. 

Recall that in (0, <5)-differential privacy, the minimum cost V* is the result of the following optimization problem, 
which is a linear program: 



V* := min ^( k )^k 

k— — oc 


(15) 


such that p k > Wk e N 


(16) 


k— — oo 


(17) 


■Ps< Ps+d + S.ys cZ.de Z, \d\ < |A|. 


(18) 



Since £(■) is a symmetric function, we can assume V is a symmetric probability distribution. In addition, we 
relax the constraint (fT8l by choosing d = A and S — S k for fc G N. Then we get a relaxed linear program, the 
solution of which is a lower bound for V*. More precisely, 

oo 

Vlb ■= min 2^£(fc)P fe (19) 

fc=i 

such that P k > \fk E N (20) 



fc=i 



(21) 



A-l 



To avoid integer rounding issues, assume is a positive integer. 
Theorem 2. // 

£(1 + A) > 2 ^C(l) + fj(£(l + »A) - £(iA)) j , (23) 

f/ien 

^* > Flb = 2(5 £.(1 + iA). (24) 

i=0 
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Proof: Consider a feasible solution to the optimization problem ( [T9t with primal variables 

j5 fc = l+iA,for i = 0,l,2,...,£-l 
Pk = \ (25) 
I otherwise 

The corresponding value of the objective function is 

25 £(l+iA). (26) 

Therefore, 



Vlb < 25 J2 C(l+iA). (27) 

i=0 

We claim that the above primal variables are the optimal solution. We prove this claim by constructing the 
corresponding dual variables. 

Associating dual variables [i with the constraint in (|2TT >. with the constraint in ( f22l . we have the dual linear 
program: 

oo 

V LB = max (i - 25 ^ Vk (28) 

fc=0 

such that n > 0, y k > 0, Vfc S N, (29) 
\» - 2/o < 0, (30) 

ife <£(*). Vfc >1. (31) 

i=max(0,fc-A+l) 



The complementary slackness conditions require that 



M~ 2/0 - J/i = -C(l), (32) 

1 + fcA 

£ j/ fe = £(l + fcA),forfc = l,2,..., — -1, (33) 



jU - 

i=2+(fc-l)A 



25 

y k = 0.yk> (l-l)A + 2. (34) 



Consider the following dual variables: 



M = £(1 + (35) 

2/ fe = 0,Vfc> (J--l)A + 2, (36) 

2/ fe = £(fc + A)-£(fc + A-l)+y(fe + A),V2<fe< (J-_1)A+1, (37) 

2d 

i 

2/! = ^(£(1 + iA) - £(*A)) > 0, (38) 



A 



2/o = M - - Vl = C(l + — ) - £(1) - ^(£(1 + iA) - £(*A)) > 0. (39) 
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It is easy to verify that these dual variables satisfy the constraints of the dual linear program, and the value of 
the objective function is 

+ 00 5J — 1 

Vk =n -25J2(V- £(! + iA )) ( 4 °) 

k=Q i=0 

2^-1 

=26 £(1 + zA). (41) 

8=0 

Therefore, by weak duality we have 

V LB > 2S J2 + (42) 

i=0 

Due to 1271 . we conclude 

Vlb = 26 £(1 + iA). (43) 

1=0 



C. Uniform Noise Mechanism 

Consider the noise with the uniform probability distribution: 

[ A. V-A<yL < A _ 1 

Pfe = J A V 26 S fc S 25 1 (44) 

I otherwise 

It is readily verified that this noise probability distribution satisfies the (0, 8) differential privacy constraint. 
Therefore, an upper bound for V* is 



Theorem 3. 

V* < V UB = 2 X £ W + X^S)- (45) 



A A '25' 

i=l 



D. Comparison of Vlb and Vjjb 

We first apply the lower bound (|24T > and upper bound (l45t to f 1 and I 2 cost functions, i.e., = |i| and C(i) = i 2 , 
in which V* corresponds to the minimum expected noise amplitude and minimum noise power, respectively. 

Note that in the case C(i) = \i\, the condition ( 1231 in Theorem|2]is 

A 1 

26 * 6 + 1 - (46) 

When A > 3, (|23j holds. 

Corollary 4. For the cost function C(i) = 

A A 

V LB = ^ + l-j, (47) 

^ = (48) 



one/ f/it« f/ze additive gap 



is a constant independent of S. 



V UB -V LB = j -I (49) 
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In the case C(i) = i 2 , the condition ( f23b in Theorem [2] is 



A .A , 1 



When A > 3, $50$ holds. 

Corollary 5. For the cost function C{i) 



V UB 

and thus the multiplicative gap 



i 2 , 




A 2 


A 2 


12S 2 


46 


A 2 


1 


125 2 


h 6< 



VLB = TTTTa - TT + A (A - !) + 4" + !. 



lim = 1. 



Proof: First we compute the lower bound Vis via 



r-i 



y LB - 2 ^ 5L{1 + iA) 
= 2(5 ^ (1 + iA) 2 



i=0 
4^1 



25 ^ (l + 2iA + i 2 A 2 ) 



i=0 



1 , nA 2i(2i i AS^i ^) 2<S 2<5 



2<5( — + 2A^-^ + A 

2(5 2 

A 1 , A 2 A 2 A 2 

e 



26 ' \26 2 6 45 
12.5 27 



The upper bound is 



25 1 5 _ 6 „,A. 









)A(A 


A 


6 


1 , A 2 1 
6 ( 2^ + 1 - 


_3A 


26 ' 


A 2 1 




12(5 2 + 6 




A 2 





11 A^! 

_ + A46 2 
A 

' 46 



Therefore, the multiplicative gap goes to one as 6 — > 0, i.e.. 

,. V UB 

lim = 

<s->o V LB 



Corollary 6. Given a positive integer m, consider the cost function C{i) = \i\ m . Then 



lim ^ = 1. (66) 

<5^0 V LB 



Proof: By induction, it is easy to show that Ym=i *™ = ®( m+i )' anc * 



m+l 

Therefore, 

, (5 v^57 _1 .-to I 5 A 



lim %i^ = l. (67) 



lim ^ = lim A ^ i= : AIW " (68) 

A m+1 
Q S (2S) m + 1 

= lim — "+ 1 - (69) 
2t?A m ^ 



m+l 

= 1. (70) 

■ 

For general cost functions, we have the following bound on the multiplicative gap between the lower bound and 
upper bound. 

Corollary 7. Given a cost function £(•) satisfying 

fe >T £(fc - A + 1) 

/or some integer T G N, an<f some positive number CeR, f/ien 

iTotf + + (72) 

Proof: Using the fact that £(•) is a monotonically increasing function for k > 0, we have 

%b - U LB = 2 £ ^C(i) + A £ ( A) _ 25 £ £(1 + »A) (73) 

i=l i=0 

< -2J£(1) + A £( * ) + 2SC(^ 1) (74) 
<(2+l)5£(£). (75) 



Therefore, 



A' V 2<T 



V UB =1+ Vub^Vlb (?6) 



< 1 + — V A7 — (77) 

2<5E.£o 1 £(l + *A) 

<1 + — A- — Ai, V2S '^ , (78) 



and thus 



2<J£(l + (£-l)A) 



&t^ 1 + < 1+ 2*> C - (?9) 
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IV. (e, 5) -Differential Privacy 

Recall that since £(■) is a symmetric function, without loss of generality, we can restrict ourselves to symmetric 
noise probability distributions, i.e., 

P fe =P_ fe ,VfceZ. (80) 

The differential privacy constraint in (|9} can be understood in some detail by choosing the subset S — Sk '■={£'■ 
I > k] for k G N. In this case we see that the noise probability distribution must satisfy the following constraints. 
For k = and d = A, 

V So < e e V s& + S. (81) 
By using the symmetry condition in (l80l and the fact that 2~Zfc*^oo ^ = from (IBTT i we get 

1 + e e e e — 1 

^o^— +e e ^P,<5+^— . (82) 

For fe = 1 and d = A, we have 

^Sx < e £ P SA+1 + (83) 

and thus 

^o £ ^+e e ^^<5+^— -. (84) 
For general k > 2 and d = A, we have 

^<e e P SA+fc +5, (85) 

and thus 

e _ , fc-1 fe+A-1 e _ 

^o^— + (e e ~l)^^ + e e ^ ^<<5 + l^_. (86) 

1=1 £=k 

A. Lower Bound 

By restricting the set S in (O to be := {£ : t > k} for k G Z and restricting e? to be A, we get the following 
relaxed linear program, the solution of which is a lower bound for V* : 

oo 

V LB :=mm 2^£(fc)P fc (87) 

k=l 

such that V k > \/k E N (88) 



2 ^ 2 

fc=i 



(89) 



1 + e e p ^ „ e e - 1 

fe=l 

Po^ + e e ^P fe <5 + ^-^ (91) 
fc=i 



, »— 1 i+A — 1 . 

e — 1 , „ . , \ - _ „ x _ „ e — 1 



7> ^_ + (^-l)]Tp fc + e e ^ P fc <£+-— - ,V*>2. (92) 



fe=i fe= 
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Define 

a^—^, (93) 
b = e- e . (94) 
To avoid integer rounding issues, assume that there exists an integer n such that 



n — 1 1 

i>*4 



(95) 



fc=0 



Theorem 8. If 



then we have 



n-l 



e~ ie (2C(iA) - C(l + (i - 1)A) - £(1 + »A)) > £(1), (96) 



" 1 5 1 e '~ 1 



V*>V LB = 2J2 ^-e- fce /:(l + fcA). (97) 



e 

k=0 



Proof: Consider the feasible primal variables {pk}kefi defined as 



p _\aV for k = 1 + «A,0 < i < n - 1 ^ 
[ otherwise 

It is straightforward to verify that the above primal variables satisfy the constraints of the relaxed linear program, 
and the corresponding value of the objective function is 

n-l 

2^ab fc £(l + fcA). (99) 

fc=0 

We prove it is also the optimal value by constructing the optimal dual variables for the corresponding dual linear 
program. 

Associating dual variables fX,yo,yx,y% with the primal constraints in (|89l,(l90l,(l9ll and (|92| l, respectively, we 
have the dual linear program: 

Vis^mm fj, - (26 + e £ - 1) £ y k (100) 

fc=0 

such that fj, > 0, y k > Vfc e N (101) 
1 1 + e e e e - 1 e £ - 1 ^ 

2^ — vo — yi — 2_^yk<® ( 102 ) 

k=2 

M-e £ y -e e yi-(e £ -l)^ y)t < £(1) (103) 

k +oo 

M-e £ 2/i-(e £ -l) Vl <>C(fc),Vfc>2. (104) 

Z=max(0,fc-A + 1) Z=fc+1 
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If the primal variables defined in ( 198b are the optimal solution, the complementary slackness conditions require 
that the corresponding dual variables satisfy that 



-foo 



M = £(l) + e e 0/o + Z/i) + (e e -l)5> (105) 

1=2 

1 + A +00 

M = £(l + A) + e e ^y, + (e e -l) ^ Vl (106) 

1=2 l=2+A 

1 + feA +00 

M = C{\ + kA) + e e ^ yi + {e e -l) ^ y ; , VI < k < n - 1, (107) 

Z=2+(fc-l)A l=2+kA 

yi = 0,yi>2 + (n-l)A. (108) 

Consider the following dual variables defined via 

/i = £(l + (n-l)A), (109) 
2/ fc = 0,Vfc>2 + (n-2)A, (110) 
y k = b(y k+A + C{k + A) - C(k + A - 1)),V2 < k < 1 + (n- 2) A, (111) 

yi = ^6 ! (£(l + zA)-£(iA)), (112) 

i=l 
ri-1 

y = X] b'MiA) - £(1 + 1)A)). (113) 

i=l 

We verify that the above dual variables satisfy the inequality J 102b in the following 

+00 

(1 + e c )y + (e e - l) Vl + (e e - 1) ^ y k - (1 > (1 14) 

+00 

^yo - tfi + e e (?/o + Vi) + (e e - 1) Vk - M > (115) 

/c=2 

<»2/o-2/i+M-^(l)-M>0 (116) 
^yo - j/i - C(l) > (117) 

n-l 

^Y,b\2£(iA) -£(l + (i-l)A) -£(l + iA)) > £(1). (118) 

It is easy to verify that the dual variables satisfy the constraints (1101b . ( 1102b . ( 1103b and (1104b in the dual linear 
program. Next we compute the corresponding value of the objective function 

+00 

tM -(26 + e e -l)J2vk (119) 

k=0 

= M - (28 + e< - D( yo + Vi + "'^r^^^ ) (120) 

e e — 1 

9A 4- P e — I 

=M (M--C(l)-yo-yi) (121) 

e e — 1 

2<5 + e e -l 



=£(1 + (n - 1)A) (£(1 + (n - 1)A) - £(1) - V 6*(£(1 + iA) - £(1 + (t - 1)A))) (122) 

e £ — 1 £ — ' 

i=l 

n-l 

=2^2ab k C(l + kA), (123) 



k=0 
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which is also the value of the objecitve function in the primal problem achieved by the primal variables defined in 
d98l >. Therefore, we conclude that 

n-1 

V LB = 2^ab k C{\ + kA). (124) 



B. Upper Bound: Uniform Noise Mechanism and Discrete Laplacian Mechanism 

Since (0, ft) -differential privacy implies (e, <5)-differential privacy, we can use the uniform noise mechanism with 
noise probability distribution defined in (l44l to preserve (e, 5) -differential privacy, and the corresponding upper 
bound is 

Theorem 9. For (e, S)-differential privacy, we have 



t/* ^ ^uniform „ v-^ ° ri-\ i ° ri A ^ rm*\ 
V < V UB J =2^ -£C{%) + ^(^). (125) 

i=l 

On the other hand, if we simply ignore the parameter 5 (i.e., set 5 = 0), we can use a discrete variant of Laplacian 
distribution to satisfy the (e, 0) -differential privacy, which implies (e, S) -differential privacy. 
More precisely, define A = e - ^. 

Theorem 10. The probability distribution V with 

Pk = l~4^k\,ykez, (126) 

1 + A 

satisfies the (e, 5)-differential privacy constraint, and the corresonding cost is 

+oo +oo . 

]T Pfc £(£0 = 2^— A fe £(fc). (127) 

k— — oo k—1 



Corollary 11. 

r Lap a r, 1 - ^ 

fe=i 



V*<^4 2 £^A fc £(*) (128) 



C. Comparison of Lower Bound and Upper Bound 

In this section, we compare the lower bound (|97l i and the upper bounds V$JP fonn and V^| P for (e, J) -differential 
privacy for i? 1 and I 2 cost functions, i.e., C(i) — \i\ and = i 2 , in which corresponds to the minimum 
expected noise amplitude and minimum noise power, respectively. We show that the multiplicative gap between the 
lower bound and upper bound is bounded by a constant as (e, i5) — > (0, 0). 

1) e < 5 regime: We first compare the gap between the lower bound Vlb and the upper bound Vy^ ™ 1 in 
the regime e < S as S — > 0. 

Corollary 12. For the cost function C(k) = \k\, in the regime e < 6, we have 

yUniform ^ 

lim < — (129) 

V LB ~ 4(1 -2 log |) 
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Proof: Using the same argument in the proof of Corollary [14] we can set e = 5. 
For the cost function C(k) = k 2 , 

n-l 



k=0 
n-l 



fe=0 

n— 1 n—X 

= 1 + 4aA &** + 2aA2 &fefc2 



n-l 

1.2 



2aA 2 &fcfc2 



= 2A : 



! /+V-h+2(^y-^)-^jp-(n-l)V 

e e 1-6 
l-f |log(|)s i 2(i°g(|)) 2 



2A 2 -e 2 ^ ~^^> 2e 3 



2 

3A 2 2 4 3, 2 3, , 2 , 
^(2-41og(^)-2(log(^)) 2 ) 



A 2 

20e 2 
A 2 



205 2 



Recall ^niform = 
Therefore, 



and thus 



T/uniform 
lim VuB 



y iB 12(2-41og(|)-2(log(f)) 2 ) 3' 



T/uniform 
lim < 



«<«-*) Vis - 12(2-41og(f) -2(log(|))2) 3 

2 J (5 < e regime: We then compare the gap between the lower bound Vlb and the upper bound 
regime <5 < e as e — » 0. 

Corollary 14. For f/ie cost function C(k) — \k\, in the regime S < e, we have 

y Lap 

lim < r w 5.29. 

*~+o V LB ~ 1 - 2 log | 

Proof: 
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For the cost function C(k) = \k\, 

n-l 

V LB = 2 ^ <z& fc £(l + fcA) ( 158 > 

fc=0 
n-l 

= 2^a6 fc (l + fcA) (159) 

fc=0 

n-l 

l + 2aA^6 fc fc (160) 

fc=0 

. 6-6" 
(1 = 6) 



fc=0 

A/ 6-6" fn-l)6 n s 



y Lap 

Given e > 0, Vlb is a decreasing function of S. Therefore, to lower bound ^ in the regime 6 < e, we only 
need to consider the case 8 = e. Thus, in the following we set 5 = e. 
Following the same calculations in the proof of Corollary [14j we have 

Vlb « y(l-21og|) (162) 

wO.19— (163) 
o 

A 

= 0.19—. (164) 

e 



On the other hand, we have 



(165) 



fc=i 
2e~* 

1 - e~ 2 i 
A 



(166) 
(167) 



as e -4 0. 
Therefore, 



and thus 



Lap 

lim = 5- w 5.29, (168) 

e =5^o V LB l-21og| 



V, 



Lap 



lim < T w 5.29. (169) 

«<*->o Vlb " l-21og| 



Corollary 15. For the cost function C{k) = k , in the regime e < 5, we have 

r Lap 



V F 2 

fa-^ p-^^t))') " 4 * <™> 

Proof: Using the same argument in the proof of Corollary [14] we can set e = S. 
For the cost function C(k) — k 2 , following the same calculations in the proof of Corollary [T3l we have 

V LB « ^(2 - 41og(|) - 2(log(^)) 2 ) (171) 
A 2 

- 2CP (172) 
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On the other hand, we have 



^ aP = 2£^AV (173) 

(174) 



(1-A) 



2 



A 2 

2—, (175) 



as e — > 0. 
Therefore, 

Inn 

e=c5->0 

and thus 



Lap 2 

IK. - p -4^) -2(^1)).) ^ 40 ' 



^Lap 

li m t 7 - 8 < « 40 (177) 
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